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I ^ Abstract 

The  mean  and  the  variance  of  a random  sample  are  independently 
distributed  if  and  only  if  the  parent  population  is  normal.  This  character- 
ization is  used  as  a basis  for  developing  a test  termed  Z-test  for  the 
composite  hypothesis  of  normality.  The  simplicity  of  Z-test  results  from 
the  computational  ease  and  the  clean  form  of  the  finite  sample  null 
distribution  of  the  test  statistic  Z.  It  compares  reasonably  in  power 
with  several  well  known  tests  of  normality  and  is  particularly  suitable 
for  a joint  assessment  of  normality.  A routine  for  computing  the  statistic 
and  its  P-value  is  given. 
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1 . INTRODUCTION 


The  problem  of  testing  a composite  hypothesis  of  normality  (mean  and/or 
variance  unknown)  is  perhaps  the  most  common  goodness-of-f it  problem  encountered 
in  the  current  statistical  practice.  For  example,  an  examination  of  residuals 
in  order  to  ascertain  the  normality  of  the  error  variable  is  a routine  part  of 
regression  analyses  and  the  analyses  of  linear  models  in  general.  The  tests 
proposed  by  Fisher  (1932),  Pearson  (1930),  Kolmogorov  and  Smirnov,  and  Cramer 
and  von  Mises  are  among  the  earliest  and  those  due  to  Shapiro  and  Wilk  (19h5) 
d'Agostino  (1971),  and  Filliben  (1975)  are  among  the  latest  procedures  con- 
structed especially  for  this  problem.  Moreover,  well  known  EOF  tests  such  as 
Kolmogorov  and  Smirnov,  Cramer  and  von  Mises,  and  Anderson  and  Darling,  tests 
originally  proposed  for  the  goodness-of-f it  problem  in  canonical  form  have 
now  been  variously  adapted  for  testing  composite  hypotheses  of  normality  (see 
Stephens  (1974)  and  Green  and  Hegacy  (197b)).  A recent  power  study  of  such  EDF 

tests  (Green  and  Hegaty  (1976))  views  them  as  "the  most  powerful  except  that 

d'Agostino's  and  the  less  convenient  Shapiro  and  Wilk  tests  of  normality  are 
comparable  in  power  to  these".  A more  recent  test  due  to  Vasicek  (197b),  based 
upon  the  entropy  characterication  of  normality  appears  to  compare  reasonably 
with  these  in  power  and  convenience,  in  that  it  requires  no  estimation  of 
parameters,  transformations  to  uniformity  as  in  EDF  tests  or  use  of  tables 
of  coefficients  as  in  the  Shapiro  and  Wilk  test. 

In  this  paper  we  propose  and  study  a test  for  the  composite  hypotheses  of 
normality  based  upon  the  well  known  fact  that  the  population  is  normal  if  and 
only  if  the  sample  mean  and  sample  variance  are  independently  distributed.  This 
test,  which  is  easy  to  motivate,  is  also  simple  to  implement,  for  it  Joes  not 
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require  ordering  and  transformations  of  observations,  use  of  tables  of 
coefficients  or  estimation  of  parameters.  Moreover,  unlike  the  null  dis- 
tributions of  most  other  test  statistics,  which  are  generally  available  either 
in  asymptotic  form  or  in  terms  of  a few  Monte  Carlo  percentiles,  the  null 
distribution  associated  with  the  present  test  is  shown  to  be  very  near  normal 
in  small  samples.  This  permits  an  easy  computation  of  the  P-value  of  the 
test  and  consequently  makes  the  joint  assessment  of  normality  simple  when 
several  independent  samples  are  available.  In  Section  2,  the  test  and  a 
development  of  the  null  distribution  of  its  statistic  are  presented.  In 
Section  3,  the  power  of  the  test  is  compared  with  the  power  of  some  well 

i .. 

known  tests.  An  e.xample  illustrating  the  joint  assessment  of  normality  is 
discussed  in  Section  4.  Section  5 contains  remarks  on  a number  of  related 
points.  Fortran  and  .-\PL  routines  which  give  P-values  of  the  test  are  given 
in  the  appendix. 

2.  THE  TEST  FOR  NORMALITY 

2.1  The  test  statistic 


/ 


Si 


Consider  the  problem  of  testing  the  composite  hypothesis  that  a sample 

, X., , . . . , of  site  n is  from  a normal  population.  It  is  well  known,  e.g.,  see 

Cramer  (1946),  and  Kagan,  Linnik  and  Rao  (1973),  that  the  hv'pothesis  is  true 

-> 

if  and  only  if  the  sample  mean  X and  the  sample  variance  S“  are  indepen- 



dently  distributed.  Thus  a test  for  the  independence  of  X and  S“  is 

also  a goodness-of-fit  test  for  the  normality.  The  apparent  limitation  that 


we  have  only  one  (X,S“)  for  testing  the  independence  of  the  pair  can  he 
circumvented  in  many  ways.  The  most  convenient  of  these  is  to  obtain  n means 
and  the  corresponding  variances,  from  the  n samples  obtained  by  deleting  one 
observation  at  a time.  Even  though  the  n pairs  so  obtained  are  not  indepen- 
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dent,  they  can  be  used  to  estimate  the  extent  of  the  dependence  between  the 
mean  and  the  variance  of  samples  from  the  population.  Because  of  its  sim- 
plicity, we  wish  to  use  the  product  moment  correlation  coefficient  as  a 
measure  of  this  dependence. 

Mow  the  test  based  upon  a product  moment  correlation  coefficient  is 
appropriate  for  testing  independence  in  a bivariate  normal  distribution. 
However,  one  of  the  marginal  distributions  in  the  present  case,  the  distribu- 
tion of  variance,  is  nonnormal  even  if  the  parent  population  is  normal.  This 
can  be  remedied  to  a considerable  extent  by  applying  the  famous  Wilson  and 
Hilferty  (1931)  cube  root  transformation  to  the  n variances  in  order  ap- 
proximately to  normalize  them.  Because  of  the  well  known  invariance  of  the 
correlation  coefficient  with  respect  to  changes  in  scale  and  origin, 


Z X.Y.  - Z X.  Z Y./n 
i=l  ^ ^ i=l  ^i  = l ^ 

r"n  ; ~ 7”  /n  ^ 

E x:  - ( 3 X )“/n  \/  i:  Y - (EY  )-/n 
i = l ^ i = l ^ Vi  = i ^ 1 


where 

Y.  = [ 2 X-  - ( E X.)“/n-l]^''-',  i = 1,2, ...,n 
" j/i  ^ ^ 

equals  in  magnitude  the  correlation  coefficient  between  U.  = E X = 
n ^ j/i  ^ 

EX.  - X.  and  Y. , which  is  the  same  as  the  correlation  coefficient 
j=l  3 X i 

between  the  n means  and  the  cube  roots  of  n variance. 

Instead  of  the  correlation  coefficient  we  propose  a monotone  function, 
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of  the  r,  given  by  Cl)  above,  as  the  statistic  for  testing  normality  of  the 
population,  and  reject  the  null  hypothesis  if 

jzj  ^constant  , (3) 

where  the  constant  is  determined  by  the  level  of  significance. 

2 . 2 The  null-distribution  of  Z 

The  above  choice  of  the  test  statistic  was  based  upon  the  e.xpectation 
that  the  robust  symmetry  and  even  near  normality  of  the  distribution  of  Z 
(Cramer,  p.  399)  computed  from  n independent  observations  from  bivariate 
distributions  with  symmetric  marginals  will  hold  in  the  present  case,  in 
which  the  bivariate  population  has  symmetric  or  almost  symmetric  marginals 
but  the  observations  are  not  independent.  The  results  of  the  Monte  Carlo 
e.xperiment  described  below  amply  justify  this  e.xpectation. 

In  order  to  estimate  the  null  distribution  of  Z in  small  samples,  5 
sets  of  1000  samples  of  size  n each,  for  25  values  of  n (n  = 5 ,7 , . . . , 100) , 
from  a normal  population,  were  simulated  using  .Marsaglia's  (1972)  random  number 
package.  For  each  of  the  samples,  Z as  defined  by  (2)  was  computed,  and  thus 
5 sets  of  1000  Z's  for  each  n were  compiled.  These  were  then  used  to  con- 
struct 5 independent  estimates  each  of  the  mean,  variance,  skewness,  and  kurtosis 
of  the  distribution  of  Z by  computing  the  corresponding  statistics  for  each  set. 
Graphical  representations  of  these  estimates  appear  in  Figures  1,  2 and  3.  It 
may  be  observed  that  for  every  n,  the  skewness  of  the  distribution  of  Z is 
negligible  and  its  kurtosis  very  near  normal.  (.Note  that  the  excess  of  kur- 
tosis of  the  logistic  distribution  which  is  regarded  as  very  close  to  normal 
is  1.2  (Johnson  and  Kotz(1970),  p.  6)).  On  the  basis  of  this  empirical  but 
substantial  evidence,  the  null  distribution  of  Z is  concluded  to  be  symmetric 
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and  very  near  normal  with  mean  0.  To  estimate  the  variance 
the  distribution,  a weighted  regression  analysis  was  performed  for  the  poly- 
nomial regression  of  [a^(Z)]  ^ on  n.  The  analysis  yields 

a = a (Z)  = (0.591730  + 0.143559  n - 0.002235  n^  + 0. 000016  n'’) (4) 

A similar  analysis  of  the  variation  of  the  excess  of  kurtosis,  fZ)  = 

2,n^ 

(Z)  - 3,  with  respect  to  1/n  gave 

— , n 

Y,  = Yo  (Z)  = -11.697157/n  + 55.059097/n^  (5) 

For  most  practical  purposes,  the  null  distribution  of  Z may  be  taken  to  be 

~> 

normal  distribution  with  mean  zero  and  variance  a“  given  by  (4).  If  greater 
accuracy  is  desired,  then  the  Edgeworth  formula  may  be  used  to  obtain 


Pr(lzl  > C)  = P(|^l  i C/a^)  =2-2  1 C/o^} 

°n  °n 

= 2 - 2{.'(C/a  ) - - 3(C/o  ) ]0(C/a  ) } , (6) 

where  <|i(x)  is  the  density  function  of  the  standard  normal  distribution 
'{'(x).  (6)  can  be  used  to  compute  the  P-value,  and  the  a-percentile  Z^  of 

Z may  be  approximated  using  the  Cornish-Fisher  approach  as 
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where  = it  ^ (a)  . 

3.  THE  POWER  OF  THE  TEST 

A Monte  Carlo  experiment  was  conducted  with  a view  to  comparing  the 
power  of  the  Z-test,  i.e.,  the  test  proposed  in  Section  2,  with  the  powers 
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of  the  other  well  known  tests.  In  this  experiment,  1000  samples  each  of 
site  n = 20  were  obtained  by  simulation  from  the  following  distributions: 

(i)  Uniform  distribution,  (ii)  Cauchy  distribution,  (iii)  Exponential  dis- 
tribution, (iv)  Gamma  (2)  distribution,  and  (v)  Beta  (2,1)  distribution. 
Again,  the  Marsaglia's  random  number  package  was  used  as  a basis  for 
generating  the  observations.  The  Z-test  at  S°6  level  of  significance  was 
performed  on  each  of  the  samples  in  order  to  estimate  its  power  at  these  al- 
ternatives. The  power  values  of  the  2-test,  along  with  the  corresponding 
values  for  competing  tests,  are  presented  in  Table  1.  These  tests  are 
separated  into  two  groups.  The  first  consists  of  tests  designed  specifically 
for  testing  the  composite  hypothesis  of  normality  and  the  other  of  the  well 
known  EDF  tests  adapted  for  this  purpose.  Some  of  the  values  of  the  power 
functions  are  taken  from  Vasicek  (1976),  some  others  from  Filliben  (1975), 
and  the  remaining  are  estimated  by  us  on  the  basis  1000  samples. 

From  the  table  it  may  be  concluded  that:  (i)  the  Z-test  is  significant- 

ly superior  to  all  other  tests  in  the  table  at  Beta  (2,1)  and  Gamma  (2) 
alternatives,  (ii)  the  Z-test  is  superior  or  comparable  with  other  tests  in 
detecting  the  exponential  alternative,  (iii)  at  the  Cauchy  alternative  the 
Z-test  is  inferior  to  all  except  Vasicek's  k,.  Hartley  and  Pfaffenberger ' s 

■y 

S“  and  McDonald  and  Katti's  L tests,  and  (iv)  at  the  uniform  alternative, 
where  most  tests  have  low  power,  the  Z-test  is  poor. 


TABLE  1 Empirical  Powers  of  tests  for  normality 
against  some  alternatives  (n  = 20,  a = 5"o) 


E.xponential 

Gamma ( 2 ) 

Beta(2,l) 

Uniform 

Cauchy 

skewness  S, 

i 1 

2 

1.414 

-0.566 

0 

0 

kurtosis  6^ 

9 

6 

2.4 

1.8 

— 

1 

.84 

.55 

.52 

.05 

.70 

S,20 

.85 

.45 

.43 

.44 

.75 

L 

.84 

.31 

.31 

.15 

.75 

(I) 

R 

.82 

.48 

.20 

.04 

.92 

7 

S" 

.29 

.11 

’5 

.09 

.34 

w 

.84 

.50 

.35 

.23 

.88 

W' 

.82 

.48 

.18 

.04 

.91 

K 

.59 

.33 

.17 

.12 

.86 

.74 

.45 

.23 

.16 

.88 

(II) 

V 

.71 

.33 

.20 

.17 

.87 

U2 

.70 

.37 

.23 

.18 

.88 

a2 

.82 

.48 

.28 

.21 

.98 

S.20' 

Vasicek 

L : 

7 

McDonald-Katti 

R : 

Filliben 

S^: 

Hart  1 ey- Pf af f enberger 

W : 

Shapiro-Wilk 

W'  : 

Shapiro-Francia 

K : 

Kolmogorov-Smirnov 

W^: 

Cramer-von  Mises 

V : 

Kuiper 

U : 

Watson 

A^  : 

Anderson-Darling 

4.  JOINT  ASSESSMENT  OF  NORMALITY  - .AN  ILLUSTR.ATION 
As  indicated  in  the  introduction,  the  Z-test  is  well-suited  to  joint 
assessment  of  normality  of  several  independent  samples.  We  illustrate  this 
point  by  considering  the  example  discussed  in  Biometrika  Tables  for  Statis- 
ticians (Pearson  and  Hartley  (1972),  p.  39)  where  a similar  analysis  is 


done  using  the  Shapiro-Wilk ' s W-test.  The  joint  assessment  involves  obtaining 
the  P-values  of  a test  of  normality  applied  to  the  independent  samples  and 
combining  these  P-values  using  a procedure  such  as  Fisher's  (1932). 

The  P-value  associated  with  a W-test  is  approximated  from  a Johnson  - S 

O 

distribution  fit.  The  P-value  associated  with  the  Z-test,  however,  is 
available  more  readily  from 

P-value  = 2 - 2<t(|z|/a^)  (8)  i 

or  more  accurately  from  (6).  If  P^.P^, . . . ,Pj^  are  the  k P-values,  then  ] 

k 2 ' 

T = -2  Z log  P.  is  distributed  as  a -variable  if  the  parent  population 
i=l  ^ 

] 

is  normal.  We  reject  the  normality  hypothesis  if  T is  large.  \ 

\ 

Example  We  take  the  first  k = 10  samples  of  size  n = 5,  as  in  ] 

. 

Biometrika  Tables  for  Statisticians,  Vol.  2,  P.  39  for  illustrating  the 
joint  assessment  of  normality  using  Shapiro-Wilk  test,  and  find  that  the 
values  of  the  Z-statistic  and  the  corresponding  P-values  are  as  follows: 


Sample 

1 

Table  2 
2 3 

4 

5 

1 

1.11067 

2.08996 

2.5950 

1.13817 

.034096 

P.  ! 

1 

.271534 

.035155 

.007936 

.259673 

.973266 

Sample 

6 

7 

8 

9 

10 

1 

.699262 

1.44872 

.776178 

.051456 

1.08966 

P. 

1 

.490654 

.149498 

.443918 

.959664 

.280701 

The  value  of  Fisher's 

combination  statistic  Tp 

for  these 

is 

10 

T^  = -2  Z log  P.  = 31.2 
F j " 1 
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which  is  very  close  to  the  95th  percentile  x'g^C^O)  = 31.4  of  the  chi- 
square  distribution,  indicating  near-significance  at  the  5°a  level.  The 
significance  probability  of  these  data  based  upon  Shapiro-Wilk  test  is 
about  10%. 


5.  REMARKS 

1.  As  mentioned  in  2.1,  there  are  many  alternatives  for  obtaining 

— 2 n 

the  replications  of  (X,  S ).  One  e.xample  is  to  take  all  possible 

pairs  of  a sample  X^,X^,...,X^  and  compute  the  mean  and  variance  from 
each  pair  as  is  done  in  McDonald  and  Katti  (1975).  However,  the  computation 
is  more  tedious  than  that  of  the  procedure  in  2.1.  Moreover,  our  studies 
indicate  that  the  use  of  the  independence  characterication  with  this  method 
leads  to  a test  very  similar  to  the  Z-test  in  power. 

C V V V K ^ 

2.  Among  adri-  the^tests  for  independence  of  a bivariate  population, 
only  Hoeffding's  D statistic  (1948)  or  its  asymptotic  equivalent  B 
statistic  due  to  Blum,  Kiefer,  and  Rosenblatt  (1961),  is  consistent.  As 
might  be  expected,  the  powers  of  these  tests  are  poor.  A simple  alternative 
to  the  product  moment  correlation  as  a measure  for  the  dependence  is  the 
Spearman  rank  correlation. 

3.  Remark  2 indicates  the  main  limitation  of  Z-test,  that  it  is  not 
consistent  against  all  alternatives.  However,  in  small  samples  it  seems  to 
fare  reasonably  well  with  respect  to  other  tests  in  power.  It  seems  that 
Shapiro-Wilk  test  is  still  the  most  powerful  omnibus  test  for  normality.  The 
Z-test  introduced  in  this  paper  provides  a simple  alternative  especially  if 
joint  assessment  of  normality  is  the  consideration. 


Figure  1 Scattergram  of  Mean  (down)  versus  Sample  Size  N (across) 


liach  |K)int  is  based  upon  1000  values. 


•igure  2 Scat tcrgrain  of  Skewness  (down)  versus  Smii|>le  Size  N (across) 


fiach  jHiint  is  based  upon  1000  values 


rigure  3 Scattergram  of  fxcess  of  Kiirtosis  (down)  versus 
Sample  Size  N (across) 


lach  point  is  based  upon  10(10  values 
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AePElWIX-.c’URTdAU  AOUTIEE  FUR  CORFU TI IIG 
THE  F-VALUE  OF  A-E'CATISTIC 


E U ddO  d TlilE  ATEET(  X,ll,d , V,A,F) 


THIE  EUddUUTIUE  CORFU  TEE  THE  P- VALUE  OF  L-TEET  FOR  UORRALITT 


UEAGE 

X 


U CJilTAlHING  THE  EAMPLE 


CALL  LTEE'H  X,IKL  ,P) 

IiJPUT  VECTOR  OF  LENGTH 
UdEERVATlONE 

NUMEER  OF  EARFLE  OBEERVATIONE 
WORE  AREA  OF  LENGTH  N 
NO  RE  AREA  OF  LENGTH  N 
E AMPLE  VALUE  OF  L-ETATIETIC 
F-VALUE  OF  L-ETATIETIC 
REQUIRED  ROU Tl N EE  e FU NCTIONE 
EUR( X,N) 

E U RE X ,N) 

CROEPRi  X,X  ,U)  FUNCTION  EUdPROGRAR  TO  GIVE  THE  EUR  OF  PRODUCT 

OF  X AND  I 

EU3R0UTINE  TO  GIVE  THE  ORDINATE  I AND  THE 
FROBAEILITI  p OF  THE  ETANDARD  NORMAL  DIETRI3UTI0N 
AT  X AND  MAI  EE  EUEETITUTED  El  COMPARABLE  ROUTINE 

r 1 


FUNCTION  EUDPROGRAR  TO  GIVE  THE  EUR  OF  X 
FUNCTION  EUB PRO  GRAM  TO  GIVE  THE  SUM  SQUARE  OF 


NORMALi  X,I,P) 


C 

U IRENE  I ON  X(  N)  ,U(  N),  V<  N ) 

E=EUR( X,N) 

EEQ=EUREQ( X,N) 

DO  10  1=1, N 
U(  I ) = E-  Xi  I) 

lU  V(I )=<  EEQ-X( I )*X( I) -U< I )*U< I) /( N-1) )**(  1.  /3.) 

CORR=( CROEPRiU , V , N) -EUR( U , N ) *EUR(  V,N) /N) / 

K ( EUREQ( U ,N)-EUR( U ,N)**2 /N)*( EUREQ(  V,N)-EUR(  V,N)**2/N)) 

2 ** . 5 

L = 0 .5*ALOG(  ( l + CORR)/(  1-CORR)) 

EIGRA=1.  /10.Syi730+0 . 143559  *//-0 .002235  *N*IHQ  . 000016  *N*N*N) 
V/12  = - 11 .697157///+ 55 . 05909  7/f  N*N) 

LN= ABE ( u / El GRA ) 

CA  lL  NORRAL  i oil  ,I  ,P) 

P=2.-2. P-GARRA2*i AN *ZN *LN - 2*oN) * I / 2^ . ) 

RETURN 
END 
C 
C 

FUNCTION  EJR(X,N) 

DIRENEION  XUl) 

E UR=^ . 

DO  10  I=1,N 
10  EUR=EURtX( I ) 

RETURN 
END 
C 

FUNCTIO N EUREQ < X,N) 

DIRENEION  X( N) 

E URE Q = 0 , 

DO  10  I=1,N 
E U RE *1  = E J RE Q± X ^ I ) * X(  I ) 


t : 

u 

I t 


f - 


)V 


RETURN 

END 
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FUil CTIU a CRUS RRi  X,F,H) 

DIM EUR 10 U X(N).I<  U) 

CROR  PR  = 0 , 

DU  10  1=1. /V 

: 0 CRO  R PR  = CR0RPRi-X(  I)*K  I) 

RETURU 

END 

C 

RUdROUTIUE  UORMAL ( X, I, P) 

(J=1.12Q'^792*EXP(  -(  X*X/2.  )) 

Y=G/2 .82842712 
XA=ABR( X) 

IF( XA.hT.2.5)  GO  TO  2 

U=l./(  XA+1.  /(  XA+2  ./(  XAi- 3./ ( XAi-^.  /(  XAi-5  . / ( XAi-6  . / ( XAt  7 . / ( XAt  3 . /(  XAi- 3 
l./(  XA+lO./(  XA+ll./(  XA-fl2  ./XA)  ))))))))))) 

IFiX.GE.Q)  GO  TO  1 

P-d*I 

GO  TO  4 

1 ?=i.-^*jr 
GO  TO  4 

2 c,T=1.41421ob/f  1.414210^3  + 0.  32  75  31 1 »^^) 

J-Gn(  ((  f0.9406  460  7»ii?-1.2  3 76  224  5 )*c:?+1.2  596  5 l3  )*£T-0.252123663  )* 
l£,’i'’+0.22  5 8 3b84o 
iF(X.GE.Q)  GO  TO  3 
P-U/2. 

GO  TO  4 

3 P-1.-U/2. 

+ RETURU 

EUD 


i 


\ 


APL  FUUCTIOil  FOR  COMPUTIUG  THE  P-VALUE  OF  Z-STATISTIC 

X-.  lUPUT  VECTOR  OF  R AMPLE  0BSERVATI0U3 

UORM  L:  APL  PUBLIC  LIBRARY  FUUCTIOU  TO  GIVE 

THE  PROBABILITY  OF  RTAUDARD  UORMAL 
DIRTRIBUTIOU  AT  Z 


V PALTER T X 

r 1 j ■/•>■(((  */X»2  )~(  X*2  ))-(J*2)*U-l)*(li3)oU-(i-/X)-XoU->-oX 

r 2 J R■>■((■^/U*V)-(f/U)»(i■/V)*U)*(((■^/U*2)-((t/U)^'2)iN)>^(■^/V*2)-((i■/V)*2)iU)*. 
F3J  2-^1  r 0.5  )«•(  U-R)  *1-R  )*RIGMA-0 . 53173  O+fO. 143553* /V)  + f0.002235’<iV*2)+0.00G01 
f4  J GAMMA2-(~11 .337137iU)-*-b5 .033037  iU*2 

r 5 J P+2-2* f ( UORM  Z )-( 1*2  4 ) *GAMMA2^(  f2*3)-3*2)*f2.7182ai828*f-f2*2)*2))*f02) 


* .V  * 3 
.5) 
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